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Abstract 

This article is concerned with moderate deviation principles of a general class of 
mean field type interacting particle models. We discuss functional moderate deviations 
of the occupation measures for both the strong r-topology on the space of finite and 
bounded measures as well as for the corresponding stochastic processes on some class 
of functions equipped with the uniform topology. Our approach is based on an original 
semigroup analysis combined with stochastic perturbation techniques and projective 
limit large deviation methods. 

Keywords : Moderate deviations, interacting particle systems, exponential inequali- 
ties, functional central limit theorems, convergence of empirical processes, large devia- 
tions for projective limits. 
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1 Introduction 

1.1 Mean Field Particle Models 

Let (E n ) n >o be a sequence of measurable spaces equipped with some a- fields (£ n )n>Q; an d we 
let V(E n ) be the set of all probability measures over the set E n , with n > 0. We consider a 
collection of transformations <& n : V{E n -\) — > V{E n ) and we denote by (r] n ) n >o a sequence 
of probability measures on E n that satisfies a nonlinear equation of the following form 

T] n+1 = $„ + i (rj n ) . (1.1) 

The mean field particle interpretations of these measure valued models relies on the fact 
that the one step mappings can be rewritten in the following form 

$n (Vn-i) = ■q n -iK ri)Vn _ 1 (1.2) 

for some collection of Markov kernels K n ^ n _ Y indexed by the time parameter n and the set of 
probability measures fi n on the space i? n _i. These models provide a natural interpretation 
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of the distribution laws rj n as the laws of a non linear Markov chain whose elementary 
transitions depend on the current distribution. In the further development of the article, 
we always assume that the mappings 

( X n)l<i<N ^ E n^ K n+l±J2»5 3 K^n+l) 

are £® JV -measurable, for any n > 0, 1 < i < N, and any measurable subset A n+ \ C E n+ \. 
In this situation, the mean field particle interpretation of this nonlinear measure valued 

model is an E^-valued Markov chain £^ = [£n'i , with elementary transitions 

V / l<i<N 

defined as 

N N 

e£S e dx I A^) = n K^^&W,*?) with rfi := -^^). (1.3) 

i=l j=l 

In the above displayed formula, A^ := a [£p N \ < p < n^j stands for the sigma-field 

generated by the random variables (£p^)o<p<n> and dx = dx 1 x . . . x dx N stands for an 
infinitesimal neighborhood of a point x = (x 1 , . . . , x N ) £ E^ ■ The initial system 
consists of N independent and identically distributed random variables with common law t/q. 
To simplify the presentation, when there is no possible confusion we suppress the parameter 
N, so that we write £ n and instead of £n and . For a thorough description of these 
discrete generation and non linear McKean type models, we refer the reader to [5]. 

A typical example we have in mind is the Feynman-Kac model associated with (0, 1]- 
valued potential functions G n and Markov transitions M n+ \ from E n into E n+ \ given by 

<5>n+i (Vn) (dy) = (* Gn (Vn) M n+1 ) (dy) := J # Gn (Tin) (dx) M n+1 (x,dy) (1.4) 

G(x) 

where ^G(v)(dx) := , rj(dx) (with rj(G) := f Gdr/(x)). 
77(G) 

In this situation, the flow of measures rj n is given for any bounded measurable function 
/ on E n by the following functional formula 

Vn(fn) = I fn 

(x) T] n (dx) oc E f n (X n ) ["J G P (X P , 

"^' E ™ V 0<p<n 

where X n stands for a Markov chain with initial distribution r/o an d Markov transitions M n . 
Recall that *g„ (v n ) can be expressed as a non-linear Markov transport equation 

^G n (Vn) = VnS Vn ,G n (1-5) 

with the Markov transitions 

S Vn ,a n (x,dy) = G n (x) 5 x (dy) + (1 - G n (x)) <£ Gn (r] n )(dy) 

we find that 

K n +i )Vn = S VntGn M n+1 
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These measure valued equations arise in a variety of applications areas, including in 
physics, biology and in advanced stochastic engineering sciences. For instance, in signal 
processing, the conditional distributions of the paths of Markov signal given a series of 
noisy observations satisfy a two-step prediction-updating equation of the form (jl.ip . In this 
context, the state space E n depends on the time parameter and it consists of all signal path 
sequences all length n. In this situation, it is worth mentioning that the corresponding 
mean field particle model in path space represents the evolution of a genealogical tree model 
associated with a genetic type algorithm. 

In the context of sequential bayesian inference, the distributions r/ n could also be the 
posterior distributions of an unknown parameter given the data collected up to time n. 
These equations also arise in physics and in molecular chemistry. In this situation, rj n is 
often interpreted as the law of a particle evolving in an absorbing medium related to some 
potential energy function. These non linear models are also used in advanced stochastic 
engineering sciences, and more particularly in stochastic optimization as well as in rare 
event simulation. In these situations, r\ n is often given by a Boltzmann-Gibbs measure 
associated with some decreasing temperature parameter or some decreasing sequence of 
critical rare event levels. In the late case, the state spaces E n represent the set of excursions 
of the reference Markov chain between two level sets. 

During the last two decades, the mean field particle interpretations of these discrete 
generation measure valued equations are increasingly identified as a powerful stochastic sim- 
ulation algorithm. They have led to spectacular results in signal processing with the corre- 
sponding particle filter technology, in stochastic engineering with interacting type Metropolis 
and Gibbs sampler methods, as well as in quantum chemistry with quantum and diffusion 
Monte Carlo algorithms leading to precise estimates of the top eigenvalues and the ground 
states of Schroedinger operators. It is clearly out of the scope of this article to review these 
models. For a more detailed discussion on these application areas, we again refer the reader 
to [U IH [TOl E], and the references therein. 

The mathematical and numerical analysis of these mean field particle models (jl.3p is one 
of the most active research subject in pure and applied probability, as well as in advanced 
stochastic engineering and computational physics. In recent years, a variety of mathematical 
results have been discussed in the literature, including propagation of chaos type properties, 
Lp-mean error bounds, as well as fluctuations theorems, large deviation principles and non 
asymptotic concentration inequalities. The moderate deviation properties can be thought 
as an intermediate asymptotic estimation between the central limit theorem and the large 
deviations principles. Most of the existing literature on moderate deviation principles is 
concerned with independent and identically distributed random sequences or Markov chain 
processes; see for instance the series of works by M.A. Arcones [TJ[2], A. de Acosta [3], A. de 
Acosta and X. Chen 0], H. Djellout and A. Guillin [13], F.Q. Gao [TT][T2]. M. Ledoux [14], 
L.M. Wu 

Surprisingly very few articles discuss moderate deviations for mean field interacting par- 
ticle models. The first pioneering article discussing moderate deviations for interacting 
processes seems to be the work by R. Douc, A. Guillin and J. Najim [9]. In this article, 
the authors prove a moderate deviation for the empirical mean value of a particle filter 
model associated with some bounded and unbounded fixed sequence of test functions. In 
our framework, we also mention that the particle filter stochastic model discussed in [9] is 
associated with a class of McKean type transitions of the form K n;TI (x,dy) = Q n (r])(dy). 
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The main simplification due to this choice of transition comes from the fact that the corre- 
sponding mean field particle model reduces to a collection of conditionally independent and 
identically distributed random variables. 

The rather weak regularity properties used in this work follow a recent article of the first 
author with E. Rio [7j. The mathematical framework developed in this recent work applies 
to a general class of mean field particle models, including Feynman-Kac integration models, 
McKean Vlasov diffusion type models, as well as McKean collision type models of gases. 
We generalized the classical Hoeffding, Bernstein and Bennett inequalities for independent 
random sequences to interacting particle systems but we left open the question of moderate 
deviation principles. In the present article, we complete this study with functional moderate 
deviations of mean field particle models for both the r-topology on the space of signed 
and bounded measures and for the empirical random field processes associated with some 
collection of functions. Our analysis is based on an original semigroup analysis combined 
with stochastic perturbation techniques and projective limit deviation methods. 

1.2 Outline of the paper. 

This paper is organized as follows. In the next section we present the main results : the 
moderate deviation principles (MDP in short) in three types : (1) in finite dimension ; (2) 
in infinite dimension but for the r-topology; (3) for empirical process indexed by a class of 
functions; and we describe some main lines leading to them. We prove the MDP in finite 
dimension in section 3. We prove in Section 4 the MDP in the r— topology by the method of 
projective limit. We establish in Section 5 the MDP for empirical processes by the method 
of metric entropy. Some complicated and technical results needed in the proofs of the main 
theorems are provided in the three Appendices : Section 6, 7 and 8. 

1.3 Some notations 

We end this introduction with some more or less traditional notations used in the present 
article. We denote respectively by Ai(E), A4q(E), and B(E), the set of all finite signed 
measures on some measurable space (E,£), the convex subset of finite signed measures v 
with v{E) = 0, and the Banach space of all bounded and measurable functions / equipped 
with the uniform norm ||/||. We also denote by Osci(-E'), the convex set of ^-measurable 
functions / with oscillations osc(/) := sup^,^ \ f(x) — f(y)\ < 1. We let fj,(f) = J /i(dx) f(x), 
be the Lebesgue integral of a function / € B(E), with respect to a measure [i G M.(E). 
We recall that a bounded integral operator M from a measurable space (E,£) into an 
auxiliary measurable space (F,T) is an operator / h-> M(f) from B{F) into B{E) such 
that the functions x h-> M(/)(x) := j F M(x,dy)f(y) are ^-measurable and bounded, for 
any / £ B(F). A Markov kernel is a positive and bounded integral operator M with 
M(l) = 1. Given a pair of bounded integral operators (Mi,M2), we let (M1M2) the 
composition operator defined by {M\M2){f) = Mi(M2(/)). For time homogenous state 
spaces, we denote by M m = M m ~ 1 M = MM m ~ l the m-th composition of a given bounded 
integral operator M, with m > 1. 

A bounded integral operator M from a measurable space (E,£) into an auxiliary mea- 
surable space (F,F) also generates a dual operator fi h-» fiM from M.(E) into A4(F) defined 
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by (fj,M)(f) := /x(M(/)). We let b(m) be the collection of constants given below 

b{2 m) 2m := and b(2m + l) 2m+1 := + 1)> 2 -(m+i/2). 

When the bounded integral operator M has a constant mass, that is M(l) (x) = M(l) (y) 
for any (x, ?/) G E 2 , the operator /i i— > 11M maps Ato(-S) into A4q(F). In this situation, 
we let f3(M) be the Dobrushin coefficient of a bounded integral operator M defined by the 
following formula 

(3(M) := sup {osc(M(/)) ; / G Osci(F)}. (1.6) 

Finally, we let $p, n , < p < n, be the semigroup associated with the measure valued 
equation defined in (jl.ip , 

= $n-l ° . . . o $p+l- 

For p = n, we use the convention $„ in = Id, the identity operator. 

2 Description of the main results and a first order fluctuation 
analysis 

2.1 Regularity conditions 

We let T(Ei,E 2 ) be the set of mappings $ : \i G P(-E'i) >-)■ $(m) G ^(£2) satisfying the 
first order decomposition 

$(m) - $(r?) = ( M - »7)^* + 7i*(At, »7) (2-1) 

where 

(i) the first order operators ^Pr^)r)&p{E\) i s some collection of bounded integral operators 

from Ei into E 2 such that Mr] G ^(-Bi), Vx G £1, (A,$)(l)(x) = and 

(!>$):= sup /3 (£>„#)< 00; (2.2) 

7/6-P(Bl) 

(ii) the collection of second order remainder signed measures (TZ \fJ',v))(i J ,,ri)eV(El) 011 ^2 

are such that 

\n*(n,T,)(f)\< [ \(fM-vr 2 (g)\ RtU,dg) (2.3) 



for some collection of integral operators i?* from B{E 2 ) into the set Osci(-Ei) 2 such 
that 



sup / osc(gi) osc(# 2 ) RS(f,d(gi (8)52)) < osc(/) (5 (i?*) with 5 (i?*) < 00. 

(2.4) 



We say that a collection of Markov transitions if„ from a measurable space (£1 , £1 ) into 
another (E 2 , £ 2 ) satisfy condition (K) as soon as the following Lipschitz type inequality is 
met for every / G Osci(I?2): 

(K) 11^ -#„](/)!!< / |( M - t?)^)! Tf(f,dh). (2.5) 
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In the above display, stands for some collection of bounded integral operators from 
B{E 2 ) into B(Ex) such that 

sup f osc(h) T*(f,dh) < osc(/) 5 (T K ) (2.6) 

ri<£P{E{)J 

for some finite constant 5 (T K ^j < oo. In the special case where K v (x,dy) = $>(r})(dy), 
for some mapping $ : r\ G V{E\) i— >• ^(r/) E V{Ei2)^ condition (K) is a simple Lipschitz 
type condition on the mapping <3?. In this situation, we denote by (<I>) the corresponding 
condition; and whenever it is met, we says that the mapping $ satisfy condition (<£). 
Throughout this paper we assume 

(HI) The given collection of McKean transitions K n rj satisfyies the Lipschitz type condi- 
tion stated in \2. 5\) and \2. 6\) . We also assume that the one step mappings 

$ n : n€V(E n -.i)—>& n (ii):=iiK n>(t €V(E n ) 

governing the equation are chosen so that <£ n 6 T(E n -i,E n ), for any n > 1. 

Several examples of non linear semigroups satisfying these weak regularity can be found 
in [7], including gaussian type mean field models, and McKean velocity models of gases. We 
illustrate our assumptions in the context of Feynman-Kac type models. In this situation, 
we have the easily checked formulae 

[$ n+ i (jj) - <S> n+ i ( V )] If) = -777 — \ (A 4 ~ v) [Gn,r) M n+ i iV (f)] 

= (a* — »7) [Gn- n M n+hv (f)} 
1 

+-77^ — r W ~ W (G n - n ) (a* - r?) [G ntV M n+1>r ,(f)\ 

with the functions 

G n , v = G n / V (G n ) and M n+1 , v (f) := M n+1 (f) - <S> n+1 (n) (/) 
Assuming that g n = sup x y G n (x)/G n (y) < 00, we find the Lipschitz estimates 

|[*n+ifa)-*n+ifa)](/)| <9n \{fi-r,)D v ^ n+1 (f)\ (2.7) 
as well as the first order estimation 

|[[* n+1 (t?) - (n)] -(jm-v) D n $ n+1 ] (/)| < 5n \{ v - n] (G n , n )\ |(m - v ) [a,*»+i(/)]| 

with the first order functional 

D v <f> n+1 (f) = G n>v M n+hv (f) 

We also mention that the corresponding one step mappings ^ n (f]) = V^n,r/ and the 
corresponding semigroup & p , n satisfy condition (& Pt n) for some collection of bounded integral 
operators T* p ' n . 
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2.2 Description of the main results 

The best way to present moderate deviations is to start with the analysis of the fluctuations 
of the particle occupation measures. For mean field particle models, these central limit 
theorems are based on a stochastic perturbation interpretation of the local sampling errors. 
The random fields associated with these perturbation models are defined by below. 

Definition 2.1 We let (Vjf , W£) be the sequence of random fields defined by the pair of 
stochastic perturbation formulae: 



rfi = Vu-iK^n +--Vf = Vn + -= W£ (2i 



1 

where = -rfYli=i^c( N '^ * s ^ e empirical distribution of • The sequence is some- 
times refereed as the local sampling random field model. 

Notice that the centered random fields have conditional variance functions given by 

HV^Un? I C-l ) = €-1 ((/» - K n^Jfn)?)] • (2-9) 

To analyze the propagation properties of the sampling errors, up to a second order remainder 
measure, by assumption that 3> n G T(E n -i, E n ), we have the first order decomposition 

$ n (r/) - $ n (jM) ~ (77 - n)D^ n (2.10) 

with a first order integral operator D^ n from B{E n ) into B(E n -\). The precise description 
of these regularity properties is provided in section 12.11 

Definition 2.2 We let (V p , 

n)o<p<n be the semigroup T)p^ n — T)pj r \Dpj r \ )n , associated with 
the integral operator D n = D Vn l & n . We use the convention T> n ^ n = Id, for p = n. 

Using the decomposition 

W" = V n N + V^V[$„(^_!) -$„(%-!)] 

n 

~ V n N + W?_ 1 D Vn _ 1 $ n ^w£ f ^Y. V p Nv vin (2.11) 

p=0 

we proved in [7] that the sequence of random fields (Vj^) n >o converges in law, as N tends to 
infinity, to the sequence of n independent, Gaussian and centered random fields (V n ) n >o with 
a covariance function with, for any f,g G B(E n ), the space of the bounded and measurable 
real functions on E n and n > 0, 

nVn{f)V n (g)) = Vn-lKn^df - ifn,^ (/)] [<? - K ntVn _M\)- (2-12) 

In addition, W£ converges in law, as the number of particles N tends to infinity, to a 
Gaussian and centered random fields 

n 

W n = Y, V P V P,n- (2-13) 

p=0 
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Concentration inequalities associated with these fluctuations theorems are developed in 
some details in a recent article of the first author with E. Rio [7J. In this article, we analyze 
asymptotic expansions for probabilities of moderate deviations. To describe with some 
precision our main results, we recall the definition of a large deviation principle (abbreviate 
LDP) for random variables. 

Definition 2.3 Let (cu(N))n>i be a sequence of positive numbers such that limjv_ s>00 a(N) = 
oo. A sequence of random variables X N with values in a topological state space (S,S) 
satisfies an LDP with speed a(N) and with good rate function L : x G S i— > L(x) G [0, oo] 
if the pair of conditions below are satisfied: 

• For every finite constant a < oo, the level sets {x £ S : L(x) < a} are compact sets. 

• For each A G S 

—I (X) < liminf — 3— logPf^ G A) < lim inf — 3— log P (X N G A) < -I (A) 

\ J N^oo a(N) y ' N->oc a(N) y ' v ' 

where, for a subset B C S, we let 1(B) := mf x£ B H x )- 

A sequence of random variables y N is said to satisfy a moderate deviation principle (ab- 
breviate MDP ) with good rate function L and speed a(N) if sequence of random variables 
X N := y N I ' \J 'a(N) satisfies an LDP with speed a(N) and with good rate function L. 

The first steps in the MDP analysis of the pair of random field sequences (Vj^ , W^) rely 
on the following pair of asymptotic Laplace expansions. 

Theorem 2.4 For any nondecreasing function a(N) such that limjv^oo "ffi = 0, any n > 
and any collection of functions f n G B(E n ), with n > 0, we have 

^ooo^V) 10gE ( ex p|^) E =\il^{v p (f P ?) (2.14) 

and 

Jrm Q -i-logE(e X p{V^V) W? (/„)}) =\^{w n (f n f) . (2.15) 

The detailed proof of the above theorem is provided in section 13.21 and section 13.31 We 
already mention that the second expansion (|2.15p is a more or less direct consequence of the 
first one (I2.14p combined with the first order decomposition (|2.1ip . 

Let us examine some direct consequences of the above theorem. For any finite subset 
F n = . . . , f%™} C B(E n ) dn , with d n > 1, we consider the projection mapping defined by 



TX Tn : |l£ M(E n ) h-> ttj^M = (m(/))/£F„ G 



By a theorem of J. Gartner and R.S. Ellis, using the asymptotic Laplace expansion (12.15P 
we prove the following corollary. 
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Corollary 2.5 The random sequence i^T n (W^) satisfy an MDP principle in~M. dn with speed 
a(N) and with the good rate function given for any v € M. dn by the following formula 

®" )= S, p^-^lfe"' j j with <^>:=X> V - ( 2 ' 16 ) 



If the covariance matrix Cj^ n := (w n (/^) W n {jnjjj ^ s invertible, then the rate 

function I-p n takes the form 

In much the same way, using the asymptotic Laplace expansion (|2.14p we readily prove the 
following corollary. 

Corollary 2.6 The random sequences [ttj^ (Vq^) , . . . , 7Tjr n (V^)] satisfy a MDP principle 
in ^do+-+dn yjfofa S p ee d a(N), with the good rate function given for any v = (vq, . . . ,v n ) € 
M. do+ - +dn by the following formula 

n 
p=0 

with the functions I^ 1 on W dn defined as f^ n by replacing in $2.16)) the field W n by V n . 

In the second part of the article, we strengthen these MDP in two ways. Firstly, we 
derive the MDP for the random fields sequences on the set of measures equipped with the 
r topology. Our main result is the following theorem. 

Theorem 2.7 We suppose that the state spaces E n are Polish spaces (metric, complete and 
separable). In this situation, the sequence of random fields (Vq*, . . . , V^) satisfy an MDP 
in the product space Y\p=o-M-(E p ) equipped with the product r topology, with speed a(N) and 
with the good rate function I[o, n ] given for any fx = (fJ- p )o< p < n 6 \\^ = QAi{E p ) by 

n 
p=0 

with the good rate functions I n on M.{E n ) defined for any [i n G Ai{E n ) by 

!„(/%) = sup L n (/)-Ir ?n _ 1 (ET n , ??n _ 1 [/-^ ri _ 1 (/)] 2 )Y (2.17) 

In addition, the sequence of random fields satisfies an MDP in A4(E n ) (equipped with 
the t topology), with speed a(N) and with the good rate function 

J n {u) = mi \ VVpOzp) : p.t. v = y>p2V> = sup ( u(f) - \e (W n (f) 2 )) . 

(2.18) 
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A more explicit description of the rate functions I n in terms of integral operators norms 
on Hilbert spaces can be found in section I4TT1 (see also section [7J in the appendix). 

Our second main result is a functional moderate deviation for stochastic processes in- 
dexed by a separable collection F n of measurable functions f n : E n — > R such that ||/ n || < 1. 
We let loo{F n ) be the space of all bounded real functions F n : f G F n h-> F n (f n ) G R 
on with the sup norm H-Fnll^ = su P/ n e.F n l-^n(/n.)l- Notice that this vector space is a 
non separable Banach space if the set of functions F n is infinite. To measure the size of a 
given class Fyi , one considers the covering numbers N(e, F n , L p (fi)) defined as the minimal 
number of L p (//)-balls of radius e > needed to cover F n . By M(e, F n ), e > 0, and by I(F n ) 
we denote the uniform covering numbers and entropy integral given by 

Af(e,F n ) = sup {j\f(e,F n ,h 2 (??))} and X(F n ) = f y/logAf(e, F n ) de. 
ijeP(E„) J o 

We further assume that 

(Al) M(e,F n ) < oo for any e > 0, and I(F n ) < oo. 

This condition implies that the set J-" n is totally bounded in L2(rj), for any distribution 77 on 
E n . Various examples of classes of functions with finite covering and entropy integral are 
given in the book of Van der Vaart and Wellner [20J (see for instance p. 86, p. 135, and 
exercise 4 on p. 150). 

For any 5 > 0, we also set 

F n (S):={h=(f-g) : (f,g) G F n s.t. ^{h 2 ) 1 ' 2 < 5} 

(A2) There exists some separable collection F' n of measurable functions /„ on E n , s.t. 
Il/nll < 1, s.t. I{F' n ) < co(n) I(F n+ i), and such that for any probability measure fi, 
any 8 > 0, we have 

- $ n +l(??n)||j- n+l{5 ) < Pa(n) ||/i — ^n||^7( ci ( n )5) 

for some finite constant Cj(n) < 00, i = 0,1,2, whose values only depend on the 
mapping 3>n+i, and on the measure rj n . 

We illustrate this regularity condition in the context of the Feynman-Kac models presented 
in dHU). Using (HZ}, we find that 



(%)] (Ml <5n 

where g n = sup^ G n (x)/G n (y) and 



(M - ( ??; \ (AWlC*) - Vn+l{h)) 



(M n+ i(M - rj n+1 (h)) < g n r] n [ " ((M n+1 (/i) - r?„+i(/i))) 



x 2 



< 9n Vn+l{h 2 ) 
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Using elementary manipulations, we show that (A2) is met with the constants ci(n) = 
l/(2y / 9n) < 1, C2(n) = 2g„ and the class of functions 

K={^--^r-, (M n+1 (f)- Vn+1 (f)) : /GJ- n+1 ) 
L 2^ r] n (G n ) J 

Using lemma 2.3 in [6], we also prove that 1(7^) < co(n) 7(.F n+ i) for some finite constant 
whose values only depends on g n . 

For any finite subset Q n C J n , we let 

be the restriction mapping defined by 7rjr nj g n (zy)(g) = for any g n G £? n . The MDP of 
the stochastic processes are described below. 

Theorem 2.8 Assume that the class of observables T n satisfies (Al), and condition (A2) 
is met. The sequence of stochastic processes satisfy the large deviation principle in 
Coo^n) with the good rate function f^ n given below 

veCaoiFn) I^(v) = sup|/^ n (7rjr ni g n (u)) : Q n C T n , withQ n finitej 

= M{J n (u)\v G M (E n ),u(f) = v(f),Vf G F n ] . 

where J n is given in i2.18\) . 

For finite sets J- n , the above theorem clearly reduces to the MDP presented in (|2.16p . 
Also observe that the r-topology on Ai{E n ) is sometimes finer than the topology associated 
with the seminorm — r]\\j- n induced by T n . For instance, when E = M. d and J- = 
{l(-oo,a;] ; x S M. d }, the topology induced by the supremum distance 

- = su p K(-°°, A) - »7((-°°, A)\ 



is strictly coarser than the r-topology. In this situation, Theorem l2.8l is a direct consequence 
of Theorem 12.71 In more general situations, by |18| or a theorem of M. A. Arcones (see for 
instance theorem 3.2 in [1]), the MDP for stochastic processes in iZooG^n) is deduced 
from the MDP of the finite marginals T^T n ,Q n ^Wn ) P^ us following exponential asymptotic 
equicontinuity condition: 

\fy > 0, limlimsup * logP ( —p]= II W^\\ ^ m > y ) = — oo 

with the collection of functions 

Fn(8) ■= {h n ■ K = (f n - g n ) with (f n ,9n) G J"^ and 7? n (^) < 5}. 
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3 Asymptotic Laplace expansions 
3.1 Some preliminary results 

Lemma 3.1 For any < p < n, we have <& p , n 6 T^E^EVJ with the first order decomposi- 
tion type formula 



(3.1) 



for some collection of bounded integral kernels -D M <3? Pjn from E p into E n and some second 
order remainder signed measures 7£* p ' n (ry, fi) . In addition, for any N > 1, we have the first 
order decomposition 

n ^ n— 1 

w n = E V v V v,n + with K%:=NJ2 K+i «, V P ) D p+1 , n (3.2) 

p=0 *^ iV p=0 

and the semigroup (^D p , n )o<p<n introduced in \2.11\) . 

Lemma 3.2 For every f G Osc\(E n ), N > 1 and any n > and m > 1, we have the L m 
estimates: 



E (K(f n )\ m Ci) m < Km) and E (| [rfi - % ] (/ n )f) 4 < b(m) ^6(T*^) 

p=0 

(3.3) 

as well as the bias estimate 



n \E(r,^f n ))- Vn (f n )\<j2m^ n : 

p=0 



(3.4) 



A detailed proof of (13. If) can be found in [7]. Formula (|3.2f) is a direct consequence of 
the following inductive decomposition 

W» = V n N + Wt±V n + VN (vti, Vn-x) ■ 
The proof of lemma I3T21 is postponed to section IfTTl in the appendix. 

3.2 Second order remainder measures 

This section is mainly concerned with non asymptotic Laplace estimates of the second order 
remainder measures introduced in lemma [3T2| namely 



w N - V v N v 

p=0 



Proposition 3.3 For every f £ Osci (E n ), N > 1, n > 0, we have the Laplace estimates : 



Vi E [0, 1/ (2r(n))) E ( exp [t VN \K%(f, 



< 



1 



a/1 - 2r(n)t 



(3.5) 



with some finite constant r(n) < J^pZo P(^> P +i,n) ( ELo S(T^p) ) 5 (i2*p+* 
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Proof: 

By (|3.2p . we have that 



n—l „ 

W(/»)l<£/ |W 

p=0 ^ 



(5) 



(f,dg). 



Combining f|3.3|) with the generalized Minkowski inequality this implies that 



l/m 



< o(2m) 2 r(n) 



We end the proof of the proposition recalling that for Gaussian centered random variable 
with E(X 2 ) = 1 we have that b(2m) 2m = E(X 2m ) and for any t G [0, l/2[ 

E(exp{tX 2 }) =Y.—\ h( ? m f m = l/v / T 3 2t. 



m>0 



Corollary 3.4 For every f £ Osci(£' n ), iV > 1, n > ; and /or every e > 0, we /iai>e 

p(K(/n)|>e + ^ ^e Me,iV) = ^lo g fl + ^V 

V VAT/ eViV y r(n) y 

In particular, for any nondecreasing function a(N) such that limjv-»oo "jy = 0, we Ziawe 

lim -l-IogP(|7^(/ n )| >ey^(N)) =-00. (3.6) 
In other words, the random fields —t==W^ and , 1 X^n=n K/^p," are ot(N)- exponentially 

a(N) ya(A r ) P 

equivalent. 
Proof: 

Using the fact that 

logE^eW^- r H) < - r (n)t-i log (1 - 2r(n)t), 
we readily find that 

P {K (fn) > e + r(n)) < exp I - sup (-^- t + t + J log (1 - 2t) 

y t<i/2 I r W z 

Choosing i = | ^1 — jq^J , we find that 

P W (/„) > , + ,(„)) < exp (-^ {l - IM log (j + 
which ends the proof of the corollary. ■ 

We end this section with a technical transfer lemma of Laplace asymptotic expansions 
for arbitrary stochastic processes. The proof is elementary, so omitted. 
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Lemma 3.5 Let (Xjy), (Yjy) two sequences of random valuables such that for any A > 0, 

lim — L-l og E(e Aa(iV)XjvN ) = A(A) and lim — \- logE ( e MN)\x N -Y N \\ = Q 
N^oo a(N) V ) y ' n^oo a(N) V / 

for some sequence a(N) increasing to infinite and some finite logarithmic moment generating 
function A(A). Then for all A > 0, we have 

lim * logE( e A «W^) = A(A). 
3.3 Asymptotic Laplace transform estimates 

This section is mainly concerned with the proof of Theorem 12.41 The fluctuation properties 
of the first order random field sequence ^p=o Vp^p^n ^ s encoded in the pair of martingale 
sequences defined below. 

Definition 3.6 We associate with collection of functions f = (f n )n>o 6 lln>o B(En), the 
pair of a (^q^\ ■ ■ ■ , £n^l -martingale sequences given below 

n ^ 

Mi N Kf)=^ V p N (fp) and Ei N \f):=^—e W { V ^(N)M! l N \f)} 

p=0 (/) 

with the stochastic product 

n 

zk N \f) ■= n E {^{v^) v P N (f P )} i i N \) . 
P =i 

For every N > 1, we notice that the angle bracket of Mn N \f) is given by 



(#(/))„ = 5;A p (M( ff )(/)) 

p=0 



with the random increments 

2 



A n (MW(/)> 



fn ~ K n, V K , (fi 



We know that the sequence of martingales Mn N \f) converges in law, as N tends to infinity, 
to the Gaussian martingale 

n n 

M n (f) = J2V P (fp) with (M(f)) n = Y J Vp-i(K P ^ 1 [{f P -K p ^_ 1 (f p )) 2 ]y 

p=0 p=l 

The main object of this subsection is to prove that 



lim logE e W-W ) \= - (M(f)) n . (3.7) 

N^oo a{Jy ) \ / 2 

Notice that the above asymptotic Laplace expansion is equivalent to (|2.14p . 
The next technical lemma is pivotal. 



14 



Lemma 3.7 There exist a pair of functions (t-^P (/))j=i,2 converge to as N tends 
to oo, such that 

e ^)Mf'(/)-^ (MW(/)) n < E^Xf) e T ^ )(/) ^ < M(Ar) (/))" 
and 

The proof of lemma 13.71 is rather technical, thus we postpone it to section 16.31 in the 
appendix. 



Proposition 3.8 



1 / . 

lim log E e 

iv^oo a(N) \ 



* {N) {vm m^w-* {M(N) (/)) ")~ 



and _ 

E (yv^|<MW(/)>„-<M(/)> n h < (1 + tZn) e {c n tf,2_ (3 _ 8) 

In the above display, c n stands for some finite constant c n := Y2p=o c (p) w ^ 
c(p):=2{l + 8{T*>)+5(T K *)} Yl s i T ^ q ' p ~ 1 )- 

0<<?<P 

Before getting into the details of the proof of the above proposition, it is convenient to 
make a couple of comments. Firstly, replacing in f|3.8|) the parameter t by we find 

that 

E ( etaW |(M W (/))„-(M(/))„|) < (l + ^c„) exp| t2a 2 ( ^ )2 4 



from which we conclude that 



Vt > 0, limsup -^E (e a W *|<^ (JV) (/)>n-<Af(/)> H , = . 
Also observe that the stochastic processes 

<(/) = -^AfW(^-i(^(/)>» 
B»(f) = -jl=M^\f)- l -{M(f)) n 

on the set of sequence / = (f p )o<p<n £ IIp=o ^C^p)' h ave the following scaling properties 

1 n 

|^(/) - 6- 1 A*(ef)\ = - (MW(/)) n (1 - e ) < - (1 - e) J>c(/ P 



ip) 

p=0 



and 

\B N n {f)-e- 1 B*{ef)\ = l -(M{f)) n (1 - e) 
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for any e 6 [0, 1]. In the above display, ef stands for the sequence of functions (e/ p )o<p<n- 
Therefore the asymptotic Laplace expansion (|3.7p is a direct consequence of the transfer 
lemma 13,51 

Now, we come to 

Proof of proposition 13.81 

Since we have {M^- N \f)) n < a 2 (f) := X^p=o osc (/p) 2 ' usm S lemma [3771 we readily prove 
that 

rm 1 n 1 ( <*(N)( z 1 '(n-l (MWf/)),^ fm 1 „ 

~rZ\f) 2 °n(f) < 7^) lo S E ( e } ) Z | <*(/)■ 

This ends the proof of the first assertion. Now, we come to the proof of (13.8H . For every 
n > 1, j] G V(E n -\) and /„ G B(E n ) we set 

S„(r/, / n ) := 77 LKn ir) (/ n - K ntV (f n )) 2 ) . 
For n = 0, we set £0(77, /o) = ^([/o — "^(/o)] 2 )- Firstly, we observe that 

E n ( V , f n ) - £ n (/Z, /„) = [* n fa) - $M] (f 2 ) + /i (K„, M (/n) 2 ) - V (KnAfnf) 

= [$ n (r?) - * n (/i)] (/ 2 ) + [ M - rj\ (K n , v (f n ) 2 ) 

+H {K n Jf n ) 2 - K n ^{f n ) 2 ) . 

This implies that 

|S n (7?,/ n ) - S„(/i,/ n )| 

< I [^(77) - ^(/i)] (/ n 2 ) I + I [/i - V ] (iW/n) 2 ) I + 2||^, M (/ n ) " K ntV (f n )\\ 

and therefore 

(E|s n (^_ 1 , f n ) - s n ( 77n _ 1 , / n )r) » 

< I (ek^-i^oo,)!™)™ 2fc l (^,*) + (E|(i^ 1 -^i)(Jir B , 1 ^ 1 (/») 2 )r)™ 

Using (|3.3p . we have the upper bound 

v^VE(|S n (r/^_ 1 ,/ n )-S n (r 7n _ lj / n )| m )- <b(m) c(n). 
One concludes that 

VN E f|(MW(/)) n - (M(/))„r) ™ < 6(m) c„. 
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The L m -inequalities stated above clearly imply that for any t > 
E (exp {tVN | (MW (/))„ - (M(/)) n | }) 

= £ m > l6l E («^ (A °(/)>n - (M( /))n ) 2m ) 

+ E m >o tJSt^ {\(MW(f))n ~ (M(f)) n \ 2m+l ) 



— Z^m>0 m! I 2 J ^ V tc »V Z^m>0 m! I 2 



where (13.81) follows. 



3.4 Proof of Theorem 12^1 

Proof of j2.14\ )- This is done in Subsection 3.3. 

Proof of \2.1J$ ==^ \2.15\) . Note that if a final time horizon n is fixed then we have for 
any function /„ G B \E n ) 

n n 

(VO < p < n f p = 2W/n)) =► 2 = E V ? V pM- 

p=0 p=0 

Let (^4„ , -B^) the pair of random fields defined below: 

1 - 1 

^ = -^4=^^, and B" = -=t=W?. 

By (HHD, we have 



lim 

jV->oo 



-^ y logE(e^) =^(/ n ) :=E ^ P (D w (/ n )) 2 J 

and by (1331) 

a(A r )2r(n)t\ "5 



Vt G [0,JV/(2a(JV)r(n))[, E (V «W|[^-^](/ n )|j < h 
This yields that 

Vt > lim logE fe to(iV) l = 

jv^oo a(N) V / 

where f)2 . 15|) follows by the transfert lemma [331 



N 
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4 Moderate deviations in r-topology 



We further require that the state spaces E n are Polish spaces. The r-topology on Ai(E n ) 
is the coarsest topology that makes the maps \x G Ai(E n ) h-> fi(A) continuous, for any 
measurable set A £ £. 



4.1 A deviation theorem for the local sampling random fields 

The main object of this section is to prove the following theorem. 

Theorem 4.1 The sequence of random fields satisfy an MDP in M.{E n ) equipped with 
the t topology, with speed a(N) and with the good rate function 



IM= sup /x(/)- = »^i ^»- 1 [/-^n > , n - 1 (/)] ■ 
feB(E n ) V 2 v 



In addition, for any n > 0, the sequence of random fields V[o n i := (Vq , , . . . , V^) satisfy an 

n 

p=0- 



MDP in the product space Ylr>=o-M(E n ), with speed a(N) and with the good rate function 



I{0,n](fJ>0, ■ ■ ■ ,fJ"n) = yilpiVp)- 
p=0 

Before entering into the proof of this theorem, we provide a more explicit representation 
of the rate functions I n . Firstly, assume that the McKean transitions K nr , are given by 
K njTI (x,dy) = <& n {rj)(dy). In this situation, we have 

K ntVn _ 1 (x,dy) = rj n (dy)^I n {ii)= sup ( //(/) - \ rj n ([f - r?„(/)] 2 ) J . 

feB(E„) V 2 \ J ) 

The variational formula given above coincides with the one of the rate function of the MDP 
associated with independent and identically distributed random sequences. In this case, we 
have that 



dp, 



drjn 



d/jL 

if fj, «C 7] n with - — G L,2(rj n ) and H-{E) = 

L 2 (r?„) dr ln 



and I n (fJ,) = oo, otherwise. A proof of this assertion is provided in section [71 in the appendix. 
In more general situations, we need to work a little harder. Let K*-^ be the adjoint 
operator of K ri)Vn _ 1 from L 2 (r? n _i) into L 2 (r? n ) given by 

V(/,s) G L 2 (??n) x L 2 (77n_i), rj n (fK* tJ]n l (g )) = ^-l^^-iC/) <?)• 
We will prove in section 7.4. the following explicit expression: 

l v — a r / \ m i du 

J n(M) = 2L* [(^m) (^w^-O ' ^ € -Mo(^n), M <^Vn,K = — & L 2 (r/ n ) 

m>0 

(4.2) 

and 7n(/i) = +oo otherwise. 
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4.2 Moderate deviations for projective limits 

The proof of the theorem is based on a projective limit interpretation of the strong topology 
on the set of finite and signed measures. We begin by first introducing several definitions. 

Definition 4.2 We let lA(E n ) the set of finite partitions U n = (£^)i<i<d G £ d of the set 
E n , with d > 1. We let o~(U n ) be the a-field generated by U n . We also let 

n Un : neM{E)^-K Un {n)eM{E n ,a{U n )) 

be the restriction of the measure fi to the sigma-field o~(U n ). 

Notice that M.(E n ,o~(U n )) can be identified with MF n ~ M. d . Furthermore, the <r-algebra 
and the r-topology induced on M.(E n , a(U n )) by the restriction mapping r Ky n coincide with 
the natural topology and the Borel sigma-field on 

Definition 4.3 We say that a partition U' n is finer than U n , and we write U' n > U n , as 
soon as we have cr(U^) D a(U n ). We also let nu k ,u n '■ A* £ M.(E, a(JJ' n )) h-> ttu; 1 ,u„(iJ') G 
M(E n ,o~(U n )) be the restriction of the measure \x on o-(U' n ) to the sigma-field a(U n ). The 
set (M. (E n , c(C/ n )),7r[// (> [/ ri ) ur>u forms a projective inverse spectrum ofU(E n ). We let 
lim^ n M. n be the projective limit space of the spectrum 



:=Lg H M(E n ,a(U n )) : W n >U n 

I U n &An 



\imM n --\ne [[ M(E n ,a(U n )) : \/U' n >U n n Un (n) = n UkiUn (ir Uk {fi)) } . 

Definition 4.4 We let ~M.(E n ) be the set of finite additive set functions from £ n into ~ML + , 
equipped with the T\-topology of setwise convergence. More precisely, a sequence fj>k G M.(E n ) 
Ti-converges to some \i G M.(E n ) as soon as }imk-+ 00 Hk(A) = fi(A), for any A £ £ n . 

We let 6 : limu n M. n — y M(£' n ) be the mapping that associates a point /j, = (p )u n &t n G 
lim^ n Ai n the set function 6 6 ~M.(E n ) defined for any A £ £ n by 

6(n) (A) = i2 Un (A) where U n G U n is such that A G a(U n ). 

By construction of the projective inverse spectrum and by definition of the t\ convergence, 
it is readily checked that 6 is an homeomorphism. 

By Theorem E2 the random sequence V^(U n ) := (V* (U%), . . . , V*(U%)) satisfies a 
MDP in M. d , with speed a(N) and with the good rate function 

lUniv 1 , ...,v d ):= sup \(u,v) 

Since we have 




d d 

U* 



Vn(K) = Vn (fu) With f u -=Y, ul1 

i=l i=l 

we readily find that 

^ V n (W n ) \ \=\ Vn-l (i^-x [f u - Kn^fuf 
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from which we conclude that 

Iu n (*vM) ■= sup (/*(/) - - r? n _i (K n , nn _ x [f - Kn^^if)] 2 ) J. 

By a theorem of D. Dawson and J. Gartner, we deduce the following 

Proposition 4.5 The sequence of random fields Vj^ satisfy an MDP in M.(E n ) (~ lim^ n M n )> 
with speed a(N) and with the good rate function 

I n (p)= sup Iu n (mj n (p))' (4-3) 
U n &A„ 

The proof of (14. li is now a direct consequence of the next lemma. 

Lemma 4.6 The domain Dom(7 n ) = |yu G M(-E n ) : I n (fJ-) < oo} o/ f/ie mapping I n is 
included in A4(E n ) and for any [i G M(E n ), the rate function I n {n) defined in |^.3| ) coincide 
with I n in ^4- IP- 



Before getting into the proof of the lemma, it is convenient to make some remarks. 

Firstly, since the relative topology on A^(-E n ) induced by the n topology coincide with 
the r topology, one concludes that the sequence of random fields satisfies a MDP in 
Ai(E n ) with good rate function I n . 

Furthermore, since the projection operators 7ru„ are T-continuous, by the contraction 
principle one concludes that the random fields sequence 7Tu n (V^fj satisfies a MDP in 
A4(E n ,a(U n )) with the good rate function 

Iu n iy) := inf {I n (p) : fx e M(E n ) s.t. TV Un (fx) = u}. 

These constructions extend in a natural way to the sequence of random fields (V^ v ) n >o- 
Indeed, using (12.141) . we find that the random sequences 

{V N (U ),...,V^(U n )) with (Uo, • • • , U n ) G (Uq x ... x £/ n ) 

satisfy an MDP in (R^ x . . . x with speed a(N) and with the good rate function 

Iu ,...,U n (vo,---,v n ) : =X] SU P ( ("p'Vp) - o E ( y p(/p P ) 2 ) ) 

p=0Up e]R d p v z / 

with the sequence of functions f% n = Yli=i u n 1?/' • The P r oof of theorem 12.71 is now easily 
completed. 

Now, we come to the 

Proof of lemma 14.61 : Consider a sequence of partitions U n 4, finer and finer when d 
increases, such that a I Ud>i U n ,d ) = £n- To prove that Dom(I n ) C Ai(E n ), we use the fact 



that 
and 

/ / diru d (p) \ 2 \ 
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See for instance (|7.5p in the appendix. Therefore ^ ) J is a IL<2-bounded martin- 

gale w.r.t. the probability measure r\ n and the filtration (c(J7 n)( i))<i>i- By the martingale 
convergence theorem, there is some £ L,2(r] n ) such that 

in L2(?7 n ), as d goes to infinity. We show now that does not depend on the sequence 
(U nj dj- In fact if {U' n d )d>\ is another such sequence of partitions, we consider the partition 
V n ^ which is finer than U n ^ and U' n d such that V^+i is finer than V n ^- By the above 
argument, we have 

in L,2(r] n ), as d — > oo. Consequently for any <7([/ n] d)-measurable and bounded function / 
(with d fixed), 

Vnihpf) = rj n ( ^^^ f) = ^.d (/*)(/) = 7r K,d(/ i )(/) = Vnfanf)- 

Thus /i /t = /i^, r/„ — a.s.. By the same way = n^, r] n — a.s.. Hence does not depend 
on {U n4 ). 

Finally for any finite partition U n and cr(J7 n )-measurable function /, taking a sequence 
of partitions (U n ^d) containing U n , we get for d large enough 

Kf) = ^M (^^^)=^«- 

Consequently \x is the measure h^r] n . 
For the last assertion, we see that 

I n (fl)= SUp SUp ( fl(f) - h£V n {ff 

U n £U n f£B(E n ,a(U n )) V 1 

sup - ^y n (/) 2 

/6U C /„ 6W „8( E n,<T(t/n)) V ^ 
1 



sup ( ,z(/) - ^EV n (f) 2 = 

/6S(B n ) V ^ / 

by the fact that for any / G B(E n ), there is a sequence fk G (Jy gW B(E n ,a(U n )) which 
converge uniformly to / over E n , and EV^(/fc) 2 — > KV n (f) 2 by the expression of KV n (f) 2 . m 



4.3 Some contraction properties 

By the contraction principle, the moderate deviation principles presented in Theorem 12.71 
can be transferred to continuous transformations of the local sampling random fields ■ 
For instance, we have the following proposition. 
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Proposition 4.7 The random fields Y2=o V p V P,n and satisfy the MDP in M(E n ) 
with the good rate function 

{n n n I 

y^Jpjflp) : (/ip)o<p<n e Y[ M{E p ) S.t. V = ^ jlpVp^n > (4.4) 
p=0 p=0 p=0 J 

= sup (u(f)-h(WM) 2 ) 
feB(E n ) V 1 

Proof: 

The fact that X]p=o VpT) v n satisfies a MDP in Ai(E n ) with the the good rate function 
is an immediate consequence of theorem 12.71 On the other hand, using (|2.14p and (|2.15p we 
prove that both random sequences 

W?(U n ) := (w»{Uk), • • • , W»(U*j) 

and 

n I n n 

V p N V p , n (U n ) := yp Nv pAU 1 n), • • • , E V v V vAK 
p=o \p=o p=o 

with U n = (?7^)i<i<d € Un, satisfies a MDP in M. d , with speed a(N) and with the good rate 
function 

J Un (v\ ...,v d ):= sup (rtf) - \ E {W n (f) 2 )) ■ 

We conclude that both random fields and Yl p =o V p N T> P;n satisfies the same MDP in 
A4(E n ) with the good rate function 

J n (y) := sup sup (v{f) - ~ E {W n (f) 2 )) = J n (u). 
U n GUn feB(E n ,a(U n )) V 1 J 

The the last formula comes from the uniqueness property of the rate function. This ends 
the proof of the proposition. ■ 



5 Moderate deviations for stochastic processes 

This section is mainly concerned with the proof of theorem 12.81 By a recent theorem of M. 
A. Arcones (see for instance theorem 3.2 in [1]), this theorem is a direct consequence of the 
following lemma. 

Lemma 5.1 Under the conditions (Al) and (A2), for any y > we have 

lim limsup . — r logP ( . II W^\\ r ,„ > « I = — oo 

with the set of functions J- n {§) given below: 

F n {5) := {h n : h n = (/„ - g n ) : (f n ,g n ) G T 2 : r) n (h 2 n ) l/2 < 5}. 
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Proof: 

The proof of this lemma is based on several key properties of empirical processes associated 
with conditionally independent sequences. These results are more or less well known, thus 
their are housed in the appendix [8l 

By construction, recalling that £ J- n , if we choose 5 = 2 then we have 

F n {5) = F n {2) = {h = {f - g) : (f,g)eT n }^T n 

Thus, using elementary manipulations we prove that the condition (A2) implies that 

ll$n+l(/i) - ®n+l{rin)\\ Fn+1 < c(n) - ?7n|| S „(^„ +l) 

for some separable collection S n (,F n+ i) of measurable functions f n on E n , s.t. ||/ n || < 1, 
and such that 

/(£„ < c'(n) I(T n+1 ) (5.1) 

for some finite constants c(n) and c'(n) < oo. 
This implies that 



N \\®n+l(Vn) — ®n+l(Vn)\\jr < c(n) VN \ \ 1^ - J] n \ \ , , 

= <n) ||^|| Sn( ^ +l) (5.2) 

On the other hand, we have 

w£ +1 = K+l + Viv [$ n+1 (n%) - $ n +l(rin)] 

and therefore 

ll^ + i|k +1 < l|Kf + i|U +1 +c(n) ||^|| s ^ +i) 



n+l 

n ml NT/ 



< j») \\ v t N 



p=0 

with S Pifl = Tip o S p+ i jn , and c p (n) = Y\ p < g<n c(q). We let 7r^[Y"] be the Orlicz norm of 

2 

an M-valued random variable Y associated with the convex function ip(u) = e u — 1, and 
defined by 

vr^(y) = inf {a G (0, oo) : E(^(\Y\/a)) < 1} 
with the convention inf0 = oo. From previous calculations, we have 

(ll^ +1 |U n+1 ) < Ec p (n) ^ (\\V p N \\^ n+i) ) 
Combining Lemma 18. II with (|5.ip . we find that 

rN 



^{\\ W n+lh n+ i) <<?{n)I{T n+l ) 
for some finite constants c"(n). By (|5.2p . we also have that 

N Tty {\\^n+l(Vn) ~ $n+l(rin)\\ Tn+1 ) < c" \n) I (T n+1 ) 
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for some finite constants d"(n). This shows that the random fields satisfy the regularity 
condition stated in (|8.2|) . 

Arguing as above, we prove that 

n 

W W nh n{ 8) < E«» W V p N h M n)5) 

for some separable collection F P:U of measurable functions f p on E p , s.t. ||/ p || < 1, and such 
that I{F p ^ n ) < oo, and for some finite constants a p (n) and f3 p (n) < oo. 

n 

with y P)n = y/[(n + l)a p (n)] and C/ Pjn (<5) := T Pjn (f3 p (n)5). On the other hand, using 
lemma [821 we have 



^ 1 °g F (ll^ V ||g p ,„ (5) >^ V / ^V)) 



j&n (-> a(N) 2 /" fe (/3p(n)g)(-^P,n)\ 2 ^ 



- ~2a ((3p (n) ,)( ^ ~ "T^" ^ (/3p(n)5) (J- p ,„); j ^iVtoo ~ 2a (/ 3 p( „)V) ( Jp,„)^ 

with some finite constant b$ (J 7 ), and 

aa(.F) < c / y/logAf(F,e) de -^ 

JO 

so that 

V 2 

t>p,n 

This ends the proof of the lemma. 



6 Appendix A. 

6.1 Proof of lemma 13.21 

The first L m almost sure estimates is a direct consequence of Kintchine's inequality, let us 
examine some direct consequences of this result. Combining the Lipschitz property ($ p n ) 
of the semigroup & Pt n with the decomposition 

n 

[Vn -Vn]=J2 " *V,n (*p(l£l))] 

p=0 

we find that (by condition (K)) 

n „ 

\ [r,%- Vn ] (/n)| = E / I^WI T l; ( > )(/< d/i ) 
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In the above displayed formulae, we have used the convention ^(^-i) = Tjo, for p = 0. The 
proof of (|3.3p is a direct consequence of the previous L m almost sure estimates. On the 
other hand, using decomposition 



N 



w, 



we find that W„ = J„ + J„ , with the pair of random measures (l£ , ) given by 



p=0 



AT tA^ 



riV 



£^g? and ^:=v^ E^(^^ P «i)) 
p=0 p=0 



with 



: = ^(^-i)**." and 7^, n = 



Under our assumptions, we have the almost sure estimates 

sup p (DJ5) < p (p$ p , n ) := sup p (V v % jn ) . 

N>1 v ' ndV(E v ) 

Using the generalized Minkowski integral inequality we find that 

N E (|7^ >n [rff, (/ n )| | A { p N \) < 5{B*»»)) 
from which we readily conclude that 



E 



N E 



'NJ»{f n 

The proof of (|3.4h is now clear. This end the proof of the lemma 



p=0 



p=0 



6.2 Proof of lemma 13.51 

Using Holder inequality, for any 5 > we find that 



Under our assumptions, we have 

|(1 + S)A N (t) - A N ((1 + S)t)\ <(1 + S) a t (6) with Hma t (5)=0 

this implies that 

E ^ e a(A0 (l+<5)A"(t)^ < E (e*(N) A N ((l+S)t))— 
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and therefore 



limsup -Lr lo g E(e^ N ^ AN V) lls < A((l + 6)t) + a t (5). 

n^oo a(N) \ ) 1 + 6 

One conclude that 

hmsnp-3— logE(e a ^ BN ^) < J-? A((l + 6)t) + a t (6) A(t). 
n^oo a(N) \ J 1 + 6 

In much the same way, if we set t s = t/(l + 6) we have 

Under our assumptions, we have 

\(l + 6)B N (t/(l + 6))-B N (t)\ <b t (6) with limb t (6) = 

<5-»0 

this implies that 
and therefore 

liminf 1 logEfe"W( 1+<5 ) BJV ^) N ) < liminf -i- logE U^b*®) + 6t((5) . 

One conclude that 

(l + 5)A(t/(l + <*))< liminf—^ logE (e^)^)) + 6 t (<5) 
AT— >oo a(ivj V / 

and letting 6 I we find that 

A(i) < liminf log E(e a W BN V). 

This ends the proof of the lemma. 



6.3 Proof of lemma 13.71 

Taking the logarithm, we find that 

n 

log 4^ (/) = £ A, ]<*(*<">(/)) 

p=0 

with the random increments 

A n log(.zW(/)) = logE(exp{v^(iV) V»(J n )} \ A { n N _\ 
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We observe that 

N 

A n log (Z" (/)) = £ IogE(exp{jrWO(/ B )} |^) 
i=i 

with the sequence of random variables 

x^Hfn) = ^ (udn - K n ^jfM N i ] )) 



such that 

= 



E(xp)(/ n )|4 

We recall that for every centered random variable X with \X\ < c for some c < oo, we have 

-yei(c) <logE(e x )- y < y e 2 (c) 
with the parameters (a 2 , ei(c), £2(0)) given below 

a 2 =E(X 2 ) ei ( c ):=|[l_e(-c)] + (^^) 2 J and e 2 (c) := [0(c) - 1] . 

In the above display, is the (^-increasing function defined by 6(x) = \ (e x — 1 — x) for 
x / and 0(0) = 1. We set 

V, = l,2 #></) := o Sup /3 (01 

Using the above estimate, for any p < n we find that 

* log (*<")(/)) - ^ A n (MW(/)) < rg?(/) A p (MW(/)) 

^ A p (MW(/)) < A p log(^(/)) - Sm A p (#)(/)). 
This yields that 

~rZ\f) ^ (M(-)(/)) n < log^)(/)-^ (M(-)(/)) n < rg?(/) ^ (#(/)), 
The end of the proof is now a direct consequence of the following formula 
exp {^(N) Mi N \f) - 2§a (MW(/))„} 

= £f } (/) exp{logzW(/)-^ (MW(/)) n } 
This ends the proof of the lemma. ■ 



A 

and 
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7 Appendix B. 

Given two measurable spaces E\ and E 2 , we consider a probability measure ft over the set 
Ei and a Markov transition M(x, dy) from E\ to £"2- We let V be the Gaussian and centered 
random field on h 2 (E 2 , /iM) defined for any / G L 2 (£ 2 , /uM) := L 2 (/LtM) by 

E(y(/) 2 )=/,(M([/-M(/)] 2 ). (7.1) 

In the above display, we have used the convention 

M([f - M(f)]\x) = M(f)(x) - M(f)(x) 2 and M(f)(x) = j M(x, dy) f(y). 



X H-> 



Definition 7.1 For any w G .M(.E 2 ) se£ 

7H= sup L(/)-±E(y(/) 2 )\ (7.2) 
/eB(£) V 2 J 

Lemma 7.2 Assume that E\ = E 2 and M(x,dy) = /J-(dy). In this situation, we have 

I(w)= sup («/(/)" 5 M([/-M(/)H) (7-3) 

and 

(l dw 2 
IH=/ M H:-^ 2 ^ 



if iu < /i with g G L 2 (//) and w(E) = 



l 2 ( m ) 

+00, otherwise. 

(7.4) 

Proof: 

To check this claim, firstly we notice that for any constant function f{x) = a we have 

w(f)-»([f-»(f)] 2 )=aw(E). 

Choosing a = b w(E) with b G R + , we readily find that 

w(E) / V6 G R+ J(iu) > 6 w(E) 2 I(w) = 00. 

Whenever w; is not absolutely continuous w.r.t. fi, we can find a measurable set A £ £ such 
that w(A) / and //(A) = 0. In this situation, we have 

Va G R+ / = a U «;(/) - A* ([/ - M/)] 2 ) = a ™(^) 2 = <». 

On the other hand, using the fact that 

f = g + a^ w(f) -\fi{[f- /i(/)] 2 ) = w(g) - \ » ([g - Kg)} 2 ) 
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as soon as w(E) = 0, we can reduce the supremum in (|T.3|) to functions / with fi(f) = 0. 
This yields 

I(w) = sup (n (^f) - \pi (f 2 )) with UM ={he L 2 (/i) : p(h) = 0}. 



Finally, we observe that 
/ dw 



(dwX 



\d[i J 



Choosing / = ^ we prove f)T.3f) . This ends the proof of the lemma. 



The analysis of the variational formula (|7.2p for more general Markov transitions M is 
a little more involved. Before getting into further details, we observe that 

/,(M([/-M(/)] 2 ) = {vM){{[f-^M){f)f)-n{{[M{f)-nM{f)f) 
< (/iM)(([/-(/,M)(/)] 2 ). 



The above inequality implies that 



I{w) := sup (w{f)-\ / u(M([/-M(/)] 2 )) > I^mH 
feB(E) V 2 J 



(7.5) 



where I^m{w) is given by (17. 4p and therefore 
7(u>) < oo =4> w < (/iM) with 



d/iM 



G L 2 (/i¥) and w(£) = 0. 



Next, we follow the analysis developed in [19]. Firstly, we notice that M is an operator 
L 2 (/iM) into L 2 (/i). 

Definition 7.3 We let M* be the adjoint operator of M from L 2 (/i) into L 2 (/iM) given by 

V(/, g) e L 2 (/i) x L 2 (/i) (/iM) (/M*(</)) = M (M(/) 5 ). 

In fact M* can be identified as a kernel M*(x2,dx\) which is the conditional law of x\ 
knowing x 2 under the probability measure //(gM(dxi, drc 2 ) := ^{dxi)M{x\, cZx 2 ) on £i x i? 2 . 
By construction, we have 

/i (M([/ - M(/)] 2 ) = ^(M(/ 2 ) - M{ff) = ( M M) (/ (Id - M;M)f) . 

We observe that (M*M) is a self adjoint operator on L 2 (//M) with 

(^M) = ^m)(m;m). 

Also notice that 

(/iM) (/ (Id -ACM)/) = / /i(dx) M(x,dy) [/(y) - M(/)(x)] 2 
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from which, we see that 

(pM) (/ (Id - M*M)/) = O f(y) = Mf(x), n(dx) M(x, dy) - a.s. (7.6) 

Let M be the subspace of those elements h in L 2 (-E2, fJ-M) such that h(y) = Mh(x), fi(dx) M(x, 
a.s.. Notice that TV = {h £ L 2 (E 2 , fiM); (Id - M*M)h = 0}. It is well known that 
M = h 2 (E2, Q-, /J>M) where Q is the sub-a-field generated by all h £ M ([E]). In particular 
TV P| Loo (#2, fJ>M) is dense in M. 

Consider the orthogonal supplementary subspace Ho(fiM) of M in t, 2 ([iM). 

In this notation, the rate function I defined in (|7.2p takes the form 

I(w) = sup (w(f) - ~ 0*M) (/ (Id - m;m)j)) . 
feHo(tiM) \ z J 

Before getting into further details, arguing as in the proof of lemma [?T2| we notice that 

I(w) < oo =>• w < fiM and w(/i) =0, V/i G 7Vp|L oc ( / uM). 

As M*M is self-adjoint, definite nonnegative on ~h 2 (fj,M) and its norm is 1, we can write 
the spectral decomposition of (Id — M*M) on T-Lq(ixM) 

(Id - M*M) = [ X dE\ = I XdE x 
7[o,i] 7(0,1] 

(E = by the very definition of Uq(^M)). The operator (Id - M*M) : Uq^iM) -)• 
%q(^M) is injective and its inverse is given by 

R^ = (Id-M;M)- 1 : Dom(R ^)cU (vM)^H (vM) 

with 

i?o, M = / \dE x and Dom(%):= Ue^oW : / T? d(E x (h),h) < oo I . 
7(o,i] A I 7(o,i] A ~ I 



Definition 7.4 I^e lei Jii(piM) be the completion of the pre-Hilbert space Ho(fiM) with 
the inner product given by 

(f t g) x := (f,(Id-M;M)(g)) 

= iiM (f (Id - M;M)(g)) = [ X d(E x (f),g) 

7(o,i] 

We define ||-||-i) as the dual space of (Hi(nM) , ||.||i) w.r.t. the canonical dual 

relation Hq(hM) = Hq(^M)' . 

By [19J, U-x(E 2 ,[iM) is the subspace of / G Uq(^M) such that ||/||_i < +oo, and 
i?o,/x can be regarded as an isomorphism from T-L^\([iM) to Hi(p,M); furthermore for any 

f en (E 2 ,fiM), 

oo 

\\ff_, = / - d(E x (f)J) = ^{/.(M^)"/). (7.7) 
7(0,1] A ^ 
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Notice also that given / G L 2 {vM) if ££L (/> ( M ^ M ) n f) < then / G n (E 2 , fxM). 

We further assume that it; <C /iM, and /i^, = satisfies (h w ,h) = for all h G 

A^niLoo^M). In this situation, if 

I(w)= sup f(W>-£ ll/H A <00 

then / —7- (h w ,f) is a bounded linear form on T-Li{(iM) f~] Loo(//M) w.r.t. the norm || • ||i. 
This yields that /i w G %-\{nM) and 

/) - ^ 11/11? = (RoAh w ), (id - m;m)U)) - \ 11/11? 
= (iWM,/)i-^ 11/11? 



2 

from which we conclude that 



1 1 1 00 

JM = -(RoAK), h w ) = -||M-i = - (M;M) n h w ). 

n=0 

In summary we have proven 

Proposition 7.5 The rate function defined in (7.2) is given by 



J( , = teY,n=o(hv,,(MZMrh w ), if w<fxM,h w = 1 ^ J eI. 2 (fiM) 
I +oo, otherwise. 



8 Appendix C. 

In the further development of this section, c < oo stands for some finite universal constant, 
whose values may vary from line to line. 

Let (fi l )i>i be a sequence of probability measures on a given measurable state space 
(E,£). During the further development of this section, we fix an integer N > 1. To clarify 
the presentation, we slightly abuse the notation and we denote respectively by 

1 N 1 N 

MX) = — ^ S Xi and M = -Jr X) A*' 

i=l i=l 

the iV-empirical measure associated with a collection of independent random variables X = 
(X % )i>i, with respective distributions (/U*)j>i, and the iV-averaged measure associated with 
the sequence of measures (//)i>i. We also consider the empirical random field sequences 

V(X) = y/N (m{X) - fi) 

We also set 

1 N 

a(ff := E (V(X)(f) 2 ) = - £ p\\f - M <(/)] 2 ) (8.1) 

i=l 
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Let J be a given collection of measurable functions / : E — > M. such that ||/|| < 1. 
No generality is lost and much convenience is gained by supposing that the unit and the 
null functions / = 1 and / = 6 7. Furthermore, to avoid some unnecessary technical 
measurability questions, we shall also suppose that J- is separable in the sense that it contains 
a countable and dense subset. For any separable class of uniformly bounded functions H 
s.t. sup/jg-^ \\h\\ < H we set 

1(H) = / y/\og Af(U,e) de 
Jo 

We further assume that there exists some probability measure ~p, on E such that 

v^tt^Hm-TJH <t(I(T)) (8.2) 

for any class of function J- satisfying the above properties, with finite entropy I(J~) < oo, 
and some non decreasing function r. In the above displayed formula, 7iv,[K] stands for 
the Orlicz norm of an M-valued random variable Y associated with the convex function 
ip(u) = e u — 1, and defined by 



7ty(Y) = inf {a 6 (0,oo) : E(^(\Y\/a)) < 1} 
with the convention inf a = oo. We recall that 



E(e* y )<2 exp(^vr^y) 2 ) (8.3) 



for any t > 0. We prove this claim using the estimate 

v ,i^(y)\ ( ^ Y ) < (^( y )) 2 , ( y 



V2 J \^{Y) J ~ 4 \^{Y) 
We consider the possibly bias random field sequence 

V(X) = VN (m(X) —~p) = V{X) + "/N (fx — ~p) 
The following lemma is satisfied without the regularity condition (|8.2p . 
Lemma 8.1 

^{\\V{X)\\ F )<cI{F) 

Proof: 

We consider a collection of independent copies X' = (X' l )i>i of the random variables X = 
(X l )i>i. Let e = (ej)i>i constitute a sequence that is independent and identically distributed 
with 

P(ei = +l) = P(ei = -l) = l/2 
We also consider the empirical random field sequences 

V e (X) := VN m e (X) 
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We also assume that (e, X, X') are independent. We associate with the pairs (e, X) and 
(e, X') the random measures m e (X) = jj Yli=i e « an d m e (X') = ^ J2iLi e i ^x H - 
We notice that 

\\m(X) - ^11* = sup \m(X){f) - E(m(X')(/))| p 

< E(\\m(X) - m(X')f T \X) 

and in view of the symmetry of the random variables (f(X l ) — f(X' l ))i>i we have 

E(\\m(X) - m(X')\f T ) = E(\\m € (X) - m e (X>)\\^) 

from which we conclude that 

E(\\V(X)\f T )<2PE(\\V e (X)\f T ) (8.4) 

By using the Chernov-Hoeffding inequality for any x = (x 1 , . . . ,x ) E E , the empirical 
process 

/— > V e (x)(/) := y/N m e (x)(f) 

is sub-Gaussian for the norm ||/||z /2 ( m ( x )) = m(3;)(/ 2 ) 1 / 2 . Namely, for any couple of functions 
/, g and any 5 > we have 



E ([V e (x)(f) - V e (x){g)f) = ||/ - 5 ||Lm*» 
and by Hoeffding's inequality 

P (\V e (x)(f) - V e (x)(g)\ >8)<2 e -5 52 /ll/-<?ll^ (mW) 



2 

(/) \ 

L 2 (m(i)) 



If we set Z = I 7=^4^^ — ) , then we find that 



/•CO 

E (e z ) - 1 = / e* P (Z > t) dt 
Jo 



e 



o 



K(s)(/)|>V6t ||/||l 2 m.)) tft 



OC 



< 2 / e* e~ 3 ' = 1 



o 

from which we conclude that 

7ty (V e (x)(/) - K(a;)(g)) < \/6||/ - slkaMz)) 
By the maximal inequalities for sub Gaussian processes (see [6], [20]), we find that 

7r^(\\V e (x)\\ T )<cI(T)<oo 
for any x S E . By (|8.4p . this clearly implies that 

^{\\V{X)\\ T )<cI{F) 

33 



This ends the proof of the lemma. 



For any 5 > 0, we also set 

F(5):={h=(f-g) : (/,<?) £ J 7 s.t. //(/i 2 ) 1 / 2 < j| 

Notice that 

AT(^),L 2 (r/),e) < 7V(J r (oo),L 2 (r/),e) < TV (J 7 , L 2 (r/), e/2) 2 
from which we conclude that 

M(F(5),e)<M(F,e/2) 2 
Lemma 8.2 Under the regularity condition f8.2\) . we have the following Laplace estimates 

E ( e WI^) < 4 exp (| [a 5 (^) 2 + 1 (tf,(J0) 
/or any t > 0, with the parameters 

rS 

a 5 {F) < c / ^\ogM(F, e) a!e 
■/ o 



and 

bsiJ 7 ) < c log Af(F, 5) [1(F) + t(c 1(F)] 
On the other hand, for any 5 > and any x > 0, we have 

^(JT) 2 + 1 (i6 5 (J-)) 2 

Explicit calculations of the Legendre-Fenchel transformation can be derived, by choosing 
t = x/ajr(5) 2 , we find the crude exponential concentration estimates 







) < - sup 


tx 

V 2 _ 


' t>0 



1 



a(N) 



log] 



1.5) 



Proof: 

For any probability measure v, we set 



d 2 , v (J : (6)) := sup Wh - h 2 \\^ 2 ( u ) 
(h u h 2 )&T(5) 



By definition, we clearly have that 

(k,„{T{5)) < 2 sup 



L 2 (» 



< 25 



/ie^(<5) 

Notice that for any couple of probability measures vi,f2, we have 
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(8.6) 



(8.7) 



with 

g(5) = {g = (h 1 -h 2 ) 2 : (h 1 ,h 2 )eT{5)} 
By the maximal inequalities for sub Gaussian processes, we have the estimate 



^i\\Ve{x)\\ m )<C 



y/\ogAf(F(5),e) de 







On the other hand, using (|8.6p and (|8.7p we prove that the r.h.s. integral is bounded by 

c25 



J Q 2d y/\ogAf(T(6),e) de 



„ 2<5+ 1 1 m (x) — a 1 1 ' - . 



+ 



< ^logAA(^(5),e) de + ^\ogN(T(b),28) x ||m(x) - p 



,1/2 
lff(a) 



,1/2 



< c ^f\ogN(F,e/2) de + c y/logAf(T,6) x ||m(x) - 7Z|| 6((5) 
We conclude that 

^(\\Ve(x)\\j: (5) ) < J 8 (F)+r 5 (F) \\m{x) -p\\g(S) 



with 



Js(F) <c f yJ\ogN(F,e) de and r s (T) < c y/\ogM(F, 5) 
Jo 

Using (|8.3p . we have 



E ( e t\\v e (X)\\ HS) \ < 2E 



e 2 



(j s (^) 2 +r a (^) 2 ||m(X)-7l|| sw ) 



2 eV- 7 *^) 2 E 



e i737^(^ a ||W| 



and by (|8.4p we have 

E ^II^WII^)) < E (e 2t WVe(x)\\ ns) ^ 

< 2e 2t2js ^ 2 E 



e %^f\\V(X) 



\Q(5) 



Using (|8.3p . we conclude that 



E( e *ll v WI^)) <4exp + 



— ]v — ^yi^wii cw 



Our next objective is to estimate the quantity tt^ \ \^V(X)^g^^\. To this end, we let 

{/» 1 ,... ) fc n «A6} c J c '(5) be the centers of n e/16 = N(T(8), L 2 (m(»)), e/16) L 2 (x)-balls of 
radius at most (e/16) covering F(5). Using the decomposition 

(hi - h 2 f - (h* - h?f = [(hi - ti) + (b? - h 2 )] [(hi - h 2 ) + (V - h j )] 
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we prove that 

\(hi - h 2 ) 2 - (K l - W) 2 \ < 8 [\h! - h l \ + \hP - h 2 \) 
for any hi,W G 3^(6) \\hi\\ V < 2). Using these estimates, we prove that 

M(g(5),h 2 (m(x)),e) <M(F(5),h 2 (m(x)),e/16) 2 <M(F,e/32) 4 

On the other hand, we have 

sup \\g\\ < 4 sup \\h\\ 2 < 16 

g&G(S) heT(S) 

This implies that 

I(G(S)) = / y/logAf(g(6),e) de < c 1(F) 
J o 

and by lemma \87l\ we can prove that 

Tr^(\\V(X)\\ H )<c / VlogAA(H,e) de 
Jo 

for any class of functions H s.t. sup ftgW \\h\\ < H. One concludes that 

^(\\V(X)\\ g{5) )<cI(F) 

and therefore 

^ (W(X)\\ g{S) ) < a{F) := c 1(F) + r(c /(^)) 

E (Vll^)lk*)) < 4exp (2t 2 J,(^) 2 + {t r5 ^ ]) \ (F)^ 

The end of the proof of the Laplace estimates is now easily completed. This ends the proof 
of the theorem. ■ 
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